Vehicle monitoring system and method

ABSTRACT

A vehicle system is provided herein. The vehicle system includes an imager generating images of a scene rearward of a vehicle. The imager is configured to separate a plurality of the images into a first portion or a second portion. A display is disposed within the vehicle and is configured to display the first portion of images. A controller is configured to analyze the second portion of images contemporaneously with the displaying of the first portion of images within the vehicle, adjust an image capture setting of the imager based on a status input, or modify each image in the second portion to increase a size of an imaged target relative to a total size of the captured scene.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority under 35 U.S.C. § 120 and the benefitof U.S. Non-provisional application Ser. No. 14/938,032 entitled“Trailer Monitoring System and Method,” filed on Nov. 11, 2015, theentire disclosure of which is incorporated herein by reference.

FIELD OF THE INVENTION

The present disclosure generally relates to trailer backup assistsystems, and more particularly, to trailer backup systems employing avision-based sensor.

BACKGROUND OF THE INVENTION

Reversing a vehicle can be challenging for many drivers. Systems used toassist a driver with backing can determine the position of the vehiclewith imager-based target detection. The accuracy and reliability of thisdetermination can be helpful for the operation of the backup assistsystem.

SUMMARY OF THE INVENTION

According to some aspects of the present disclosure, a vehicle system isprovided herein. The vehicle system includes an imager generating imagesof a scene rearward of a vehicle. The imager is configured to separate aplurality of the images into a first portion or a second portion. Adisplay disposed within the vehicle and configured to display the firstportion of images. A controller is configured to analyze the secondportion of images contemporaneously with the displaying of the firstportion of images within the vehicle, adjust an image capture setting ofthe imager based on a status input, or modify each image in the secondportion to increase a size of an imaged target relative to a total sizeof the captured scene.

According to some aspects of the present disclosure, a vehicle assistmethod is provided herein. The method includes generating images ofimaging a scene rearward of a vehicle. The method also includesseparating the images into a first portion and a second portion. Themethod further includes displaying the first portion of images on adisplay. The method includes using a controller to set a referencepoint. Lastly, the method includes analyzing the second portion ofimages with respect to the reference point to determine an adjustment toa camera image capture setting.

According to some aspects of the present disclosure, a vehicle system isprovided herein. The vehicle system includes an imager configured toimage a vehicle rearward scene. The imager is configured to alternatelydistribute a plurality of images from the imager into independent firstand second portions. A display is configured to display the firstportion of images. A controller is configured to receive the secondportion of images and analyze the second portion of images to determineat least one vehicle-related information.

These and other features, advantages, and objects of the presentinvention will be further understood and appreciated by those skilled inthe art by reference to the following specification, claims, andappended drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

In the drawings:

FIG. 1 is a top perspective view of a vehicle attached to a trailer withone embodiment of a hitch angle sensor for operating a trailer backupassist system;

FIG. 2 is a block diagram illustrating one embodiment of the trailerbackup assist system having a steering input device, a curvaturecontroller, and a trailer braking system;

FIG. 3 is a plan view of an embodiment of a rotatable knob for selectinga desired curvature of a trailer and a corresponding schematic diagramillustrating a vehicle and a trailer with various trailer curvaturepaths correlating with desired curvatures that may be selected;

FIG. 4 is a schematic diagram showing a backup sequence of a vehicle anda trailer implementing various curvature selections with the trailerbackup assist system, according to one embodiment;

FIG. 5 is a block diagram illustrating a system for adjusting an imagecapture setting of a camera used in a trailer backup assist system,according to one embodiment;

FIG. 6 is a flow chart of a routine for adjusting an image capturesetting of a camera used in a trailer backup assist system, according toone embodiment;

FIG. 7 is a block diagram of the trailer backup assist system, accordingto one embodiment, having a first portion of images from the camera tobe displayed within the vehicle and a second portion of images analyzedwithin the trailer monitoring system;

FIG. 8 is a block diagram illustrating one embodiment of a trailermonitoring system for use with the trailer backup assist system shown inFIGS. 1 and 2;

FIG. 9 is an example of an image captured by a camera of the trailermonitoring system of FIG. 8;

FIG. 10 is a flow diagram illustrating a trailer monitoring methodaccording to one embodiment;

FIG. 11 shows a modified version of the captured image shown in FIG. 9;

FIG. 12A is an exemplary first image displayed on the display within thevehicle for interlacing images through object motion estimation; and

FIG. 12B is an exemplary second image displayed on the display withinthe vehicle illustrating the interlaced images through object motionestimation.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

For purposes of description herein, it is to be understood that thedisclosed trailer backup assist system and the related methods mayassume various alternative embodiments and orientations, except whereexpressly specified to the contrary. It is also to be understood thatthe specific devices and processes illustrated in the attached drawings,and described in the following specification, are simply exemplaryembodiments of the inventive concepts defined in the appended claims.While various aspects of the trailer backup assist system and therelated methods are described with reference to a particularillustrative embodiment, the disclosed invention is not limited to suchembodiments, and additional modifications, applications, and embodimentsmay be implemented without departing from the disclosed invention.Hence, specific dimensions and other physical characteristics relatingto the embodiments disclosed herein are not to be considered aslimiting, unless the claims expressly state otherwise.

Referring to FIGS. 1-12B, reference numeral 10 generally designates atrailer backup assist system for controlling a backing path of a trailer12 attached to a vehicle 14 by allowing a driver of the vehicle 14 tospecify a desired curvature 16 of the backing path of the trailer 12. Inone embodiment, the trailer backup assist system 10 automatically steersthe vehicle 14 to guide the trailer 12 on the desired curvature orbacking path 16 as a driver uses the accelerator and brake pedals tocontrol the reversing speed of the vehicle 14. To monitor the positionof the trailer 12 relative to the vehicle 14, the trailer backup assistsystem 10 may include a sensor system 18 that senses or otherwisedetermines a hitch angle between the trailer 12 and the vehicle 14.

According to one embodiment, the sensor system 18 may include a hitchangle sensor 20 that employs a camera 22 (e.g., video imaging camera)that has an imaging field of view 24 located and oriented to capture oneor more images (i.e., frames) of the trailer 12. A display 26 isdisposed within the system that receives a first portion of images 28from the camera 22 and a second portion of images 30 is received by atrailer monitoring system 140 for analyzing vehicle and/or trailerrelated information.

With reference to the embodiment shown in FIG. 1, the vehicle 14 is apickup truck embodiment that is equipped with one embodiment of thetrailer backup assist system 10 for controlling the backing path of thetrailer 12 that is attached to the vehicle 14. Specifically, the vehicle14 is pivotally attached to one embodiment of the trailer 12 that has abox frame 34 with an enclosed cargo area 36, a single axle 38, and atongue 40 longitudinally extending forward from the enclosed cargo area36. The illustrated trailer 12 also has a trailer hitch connector in theform of a coupler assembly 42 that is connected to a vehicle hitchconnector in the form of a hitch ball 44. The coupler assembly 42latches onto the hitch ball 44 to provide a pivoting ball jointconnection 46 that allows for articulation of the hitch angle γ (FIG.3). It should be appreciated that additional embodiments of the trailer12 may alternatively couple with the vehicle 14 to provide a pivotingconnection, such as by connecting with a fifth wheel connector. It isalso contemplated that additional embodiments of the trailer 12 mayinclude more than one axle 38 and may have various shapes and sizesconfigured for different loads and items, such as a boat trailer or aflatbed trailer.

Still referring to FIG. 1, the sensor system 18 in the illustratedembodiment includes a vision-based hitch angle sensor 20 for estimatingthe hitch angle γ between the vehicle 14 and the trailer 12. Theillustrated hitch angle sensor 20 employs a camera 22 that may belocated proximate an upper region of the vehicle tailgate 48 at the rearof the vehicle 14, as shown, such that the camera 22 may be elevatedrelative to the tongue 40 of the trailer 12. The illustrated camera 22has an imaging field of view 24 located and oriented to capture one ormore images of the trailer 12, including a region containing one or moredesired target placement zones 174 (FIG. 9) where a target 50 may besecured.

Although it is contemplated that the camera 22 may capture images of thetrailer 12 without a target 50 to determine the hitch angle γ, in theillustrated embodiment, the trailer backup assist system 10 includes atarget 50 placed on the trailer 12 to allow the trailer backup assistsystem 10 to utilize information acquired via image acquisition andprocessing of the target 50. For instance, the illustrated camera 22 mayinclude a video imaging camera that repeatedly captures successiveimages of the trailer 12 that may be processed to identify the target 50and its location on the trailer 12 for determining movement of thetarget 50 and the trailer 12 relative to the vehicle 14 and thecorresponding hitch angle γ. It should also be appreciated that thecamera 22 may include one or more video imaging cameras and may belocated at other locations on the vehicle 14 to acquire images of thetrailer 12 and the desired target placement zone 174, such as on apassenger cab 52 of the vehicle 14 to capture images of a goosenecktrailer. Furthermore, it is contemplated that additional embodiments ofthe hitch angle sensor 20 and the sensor system 18 for providing thehitch angle γ may include one or a combination of a potentiometer, amagnetic-based sensor, an optical sensor, a proximity sensor, arotational sensor, a capacitive sensor, an inductive sensor, or amechanical based sensor, such as a mechanical sensor assembly mounted tothe pivoting ball joint connection 46, energy transducers of a reverseaid system, a blind spot system, and/or a cross traffic alert system,and other conceivable sensors or indicators of the hitch angle γ tosupplement or be used in place of the vision-based hitch angle sensor20.

With reference to the embodiment of the trailer backup assist system 10shown in FIG. 2, the trailer backup assist system 10 may receive vehicleand trailer status-related information from a plurality of sensors anddevices. The plurality of sensors and devices may be used in lieu of thehitch angle sensor 20 in the event that one or more sensors used fordetermining the hitch angle γ (FIG. 3) fail. This trailer status-relatedinformation includes positioning information from a positioning device54, which may include a global positioning system (GPS) on the vehicle14 or a hand held device, to determine a coordinate location of thevehicle 14 and the trailer 12 based on the location of the positioningdevice 54 with respect to the trailer 12 and/or the vehicle 14 and basedon the estimated hitch angle γ. The positioning device 54 mayadditionally or alternatively include a dead reckoning system fordetermining the coordinate location of the vehicle 14 and the trailer 12within a localized coordinate system based at least on vehicle speed,steering angle, and hitch angle γ. Any vehicle sensor 56 may communicatevehicle information to the trailer backup assist system 10, which mayinclude a speed of the vehicle 14 from a speed sensor 58 and a yaw rateof the vehicle 14 from a vehicle yaw rate sensor 60.

As further shown in FIG. 2, one embodiment of the trailer backup assistsystem 10 is in communication with a power assist steering system 62 ofthe vehicle 14 to operate the steered wheels 64 (FIG. 1) of the vehicle14 for moving the vehicle 14 in such a manner that the trailer 12 reactsin accordance with the desired curvature 16 of the trailer 12. In theillustrated embodiment, the power assist steering system 62 is anelectric power-assisted steering (EPAS) system that includes an electricsteering motor 66 for turning the steered wheels 64 to a steering anglebased on a steering command, whereby the steering angle may be sensed bya steering angle sensor 68 of the power assist steering system 62. Thesteering command may be provided by the trailer backup assist system 10for autonomously steering during a backup maneuver and may alternativelybe provided manually via a rotational position (e.g., steering wheelangle) of a steering wheel 70 (FIG. 1). However, in the illustratedembodiment, the steering wheel 70 of the vehicle 14 is mechanicallycoupled with the steered wheels 64 of the vehicle 14, such that thesteering wheel 70 moves in concert with steered wheels 64 via aninternal torque, preventing manual intervention with the steering wheel70 during autonomous steering. More specifically, a torque sensor 72 isprovided on the power assist steering system 62 that senses torque(e.g., gripping and/or turning) on the steering wheel 70 that is notexpected from autonomous control of the steering wheel 70 and thereforeindicative of manual intervention by the driver. In some embodiments,external torque applied to the steering wheel 70 may serve as a signalto the controller 74 that the driver has taken manual control and forthe vehicle 14 to discontinue steering maneuvers and/or alerts.

In alternative embodiments, some vehicles 14 have a power assiststeering system 62 that allows a steering wheel 70 to be partiallydecoupled from movement of the steered wheels 64 of such a vehicle 14.Accordingly, the steering wheel 70 can be rotated independent of themanner in which the power assist steering system 62 of the vehiclecontrols the steered wheels 64 (e.g., autonomous steering as commandedby the trailer backup assist system 10). As such, in these types ofvehicles 14 where the steering wheel 70 can be selectively decoupledfrom the steered wheels 64 to allow independent operation thereof, thesteering wheel 70 may be used as a steering input device 90 for thetrailer backup assist system 10.

Referring again to the embodiment illustrated in FIG. 2, the powerassist steering system 62 provides the controller 74 of the trailerbackup assist system 10 with information relating to a rotationalposition of steered wheels 64 of the vehicle 14, including a steeringangle. The controller 74 in the illustrated embodiment processes thecurrent steering angle, in addition to other vehicle 14 and trailer 12conditions, to guide the trailer 12 along the desired curvature 16. Itis conceivable that the trailer backup assist system 10, in additionalembodiments, may be an integrated component of the power assist steeringsystem 62. For example, the power assist steering system 62 may includea trailer backup assist algorithm for generating vehicle steeringinformation and commands as a function of all or a portion ofinformation received from the steering input device 90, the hitch anglesensor 20 (FIG. 1), the power assist steering system 62, a vehicle brakecontrol system 76, a powertrain control system 78, and other vehiclesensors and devices.

With further reference to FIG. 2, the vehicle brake control system 76may also communicate with the controller 74 to provide the trailerbackup assist system 10 with braking information, such as vehicle wheelspeed, and to receive braking commands from the controller 74. Forinstance, vehicle speed information can be determined from individualwheel speeds as monitored by the brake control system 76. Vehicle speedmay also be determined from the powertrain control system 78, the speedsensor 58, and the positioning device 54, among other conceivable means.In some embodiments, individual wheel speeds can also be used todetermine a vehicle yaw rate, which can be provided to the trailerbackup assist system 10 in the alternative, or in addition to, thevehicle yaw rate sensor 60.

In certain embodiments, the trailer backup assist system 10 can providevehicle braking information to the brake control system 76 for allowingthe trailer backup assist system 10 to control braking of the vehicle 14during backing of the trailer 12. For example, the trailer backup assistsystem 10, in some embodiments, may regulate speed of the vehicle 14during backing of the trailer 12, which can reduce the potential forunacceptable trailer backup conditions. Examples of unacceptable trailerbackup conditions include, but are not limited to, a vehicle 14over-speed condition, a high hitch angle rate, trailer angle dynamicinstability, a calculated theoretical trailer jackknife condition(defined by a maximum vehicle steering angle, drawbar length, towvehicle wheelbase, and an effective trailer length), or physical contactjackknife limitation (defined by an angular displacement limit relativeto the vehicle 14 and the trailer 12), and the like. Unacceptabletrailer backup conditions may result from the failure of one or moresensors and/or inputs on the vehicle 14 and/or trailer 12 to provideinformation to the controller 74 of the trailer backup assist system 10.In such events, the driver may be unaware of the failure until theunacceptable trailer backup condition is imminent or already happening.Therefore, it is disclosed herein that the trailer backup assist system10 can generate an alert signal corresponding to a notification of anactual, impending, and/or anticipated unacceptable trailer backupcondition, and prior to driver intervention, generate a counter measureto prevent such an unacceptable trailer backup condition.

The powertrain control system 78, as shown in the embodiment illustratedin FIG. 2, may also interact with the trailer backup assist system 10for regulating speed and acceleration of the vehicle 14 during backingof the trailer 12. As mentioned above, regulation of the speed of thevehicle 14 may be necessary to limit the potential for unacceptabletrailer backup conditions such as, for example, jackknifing and trailerangle dynamic instability, or when the failure of a sensor and/or aninput device 90 is detected. Similar to high-speed considerations asthey relate to unacceptable trailer backup conditions, highacceleration, and high dynamic driver curvature requests can also leadto such unacceptable trailer backup conditions.

With continued reference to FIG. 2, the trailer backup assist system 10,in the illustrated embodiment, may communicate with one or more devices,including a vehicle alert system 80, which may prompt visual, auditory,and tactile warnings. For instance, vehicle brake lights 82 and vehicleemergency flashers may provide a visual alert and a vehicle horn 84and/or speaker 86 may provide an audible alert. Additionally, thetrailer backup assist system 10 and/or vehicle alert system 80 maycommunicate with a human machine interface (HMI) 88 for the vehicle 14.The HMI 88 may include the vehicle display 26, in the form of acenter-stack mounted navigation or entertainment display 26 (FIG. 1)capable of displaying images indicating the alert. Such an embodimentmay be desirable to notify the driver of the vehicle 14 that a sensorand/or input device 90 used by the backup assist system 10 had failed.Further, the trailer backup assist system 10 may communicate viawireless communication with another embodiment of the HMI 88, such aswith one or more handheld or portable devices, including one or moresmartphones. The portable device may also include the display 26 fordisplaying one or more images and other information to a user. Forinstance, the portable device may display an image indicating the sensorand/or input device 90 that has failed. In addition, the portable devicemay provide feedback information, such as visual, audible, and tactilealerts.

As further illustrated in FIG. 2, the trailer backup assist system 10may include a steering input device 90 that is connected to thecontroller 74 for allowing communication of information therebetween. Itis disclosed herein that the steering input device 90 can be coupled tothe controller 74 in a wired or wireless manner. The steering inputdevice 90 provides the trailer backup assist system 10 with informationdefining the desired backing path of travel of the trailer 12 for thecontroller 74 to process and generate steering commands. Morespecifically, the steering input device 90 may provide a selection orpositional information that correlates with a desired curvature 16 ofthe desired backing path of travel of the trailer 12. Also, the trailersteering commands provided by the steering input device 90 can includeinformation relating to a commanded change in the path of travel, suchas an incremental change in the desired curvature 16, and informationrelating to an indication that the trailer 12 is to travel along a pathdefined by a longitudinal centerline axis of the trailer 12, such as adesired curvature value of zero that defines a substantially straightpath of travel for the trailer 12. Given the importance of the steeringinput device 90 in controlling the vehicle 14 and trailer 12 while inmotion, safety systems directed toward mitigating a failure of thesteering input device 90 by generating a countermeasure may be adesirable feature in the trailer backup assist system 10. Accordingly,the controller 74 of the trailer backup assist system 10 may detectfailure of the steering input device 90 and engage a countermeasure whenthe steering input device 90 fails, until the driver regains operationalcontrol of the vehicle 14.

The steering input device 90, according to one embodiment, may include amovable control input device for allowing a driver of the vehicle 14 tocommand desired trailer steering actions or otherwise select and alter adesired curvature 16. For instance, the movable control input device maybe a rotatable knob 92, which can be rotatable about a rotational axisextending through a top surface or face of the knob 92. In otherembodiments, the rotatable knob 92 may be rotatable about a rotationalaxis extending substantially parallel to a top surface or face of therotatable knob 92. Furthermore, the steering input device 90, accordingto additional embodiments, may include alternative devices for providinga desired curvature 16 or other information defining a desired backingpath, such as a joystick, a keypad, a series of depressible buttons orswitches, a sliding input device, various user interfaces on atouch-screen display 26, a vision based system for receiving gestures, acontrol interface on a portable device, and other conceivable inputdevices as generally understood by one having ordinary skill in the art.It is contemplated that the steering input device 90 may also functionas an input device for other features, such as providing inputs forother vehicle features or systems.

Still referring to the embodiment shown in FIG. 2, the controller 74 isconfigured with a microprocessor 94 to process logic and routines storedin memory 96 that receive information from the sensor system 18, thehitch angle sensor 20, the steering input device 90, the power assiststeering system 62, the vehicle brake control system 76, the trailerbraking system, the powertrain control system 78, and other vehiclesensors and devices. The controller 74 may generate vehicle steeringinformation and commands as a function of all, or a portion of, theinformation received. Thereafter, the vehicle steering information andcommands may be provided to the power assist steering system 62 foraffecting steering of the vehicle 14 to achieve a commanded path oftravel for the trailer 12. The controller 74 may include themicroprocessor 94 and/or other analog and/or digital circuitry forprocessing one or more routines. Also, the controller 74 may include thememory 96 for storing one or more routines, including a hitch angleestimation routine 98, an operating routine 100, a curvature routine102, and a steering input failure mitigation routine 104. It should beappreciated that the controller 74 may be a stand-alone dedicatedcontroller or may be a shared controller integrated with other controlfunctions, such as integrated with the sensor system 18, the powerassist steering system 62, and other conceivable onboard or off-boardvehicle control systems.

As shown in FIG. 3, a driver can turn the rotatable knob 92 to provide adesired curvature 16 while the driver of the vehicle 14 backs thetrailer 12. In the illustrated embodiment, the rotatable knob 92 rotatesabout a central axis between a center or middle position 106corresponding to a substantially straight backing path 16 of travel, asdefined by the longitudinal direction of the trailer 12, and variousrotated positions 108, 110, 112, 114 on opposing sides of the middleposition 106, commanding a desired curvature 16 corresponding to aradius of the desired backing path of travel for the trailer 12 at thecommanded rotated position. It is contemplated that the rotatable knob92 may be configured in accordance with embodiments of the disclosedsubject matter and omit a means for being biased to an at-rest positionP(AR) between opposing rotational ranges of motion. Lack of such biasingmay allow a current rotational position of the rotatable knob 92 to bemaintained until the rotational control input device is manually movedto a different position. It is also conceivable that the steering inputdevice 90 may include a non-rotational control device that may beconfigured to selectively provide a desired curvature 16 and to overrideor supplement an existing curvature value. Examples of such anon-rotational control input device include, but are not limited to, aplurality of depressible buttons (e.g., curve left, curve right, andtravel straight), a touch screen on which a driver traces or otherwiseinputs a curvature for a path of travel commands, a button that istranslatable along an axis for allowing a driver to input backing pathcommands, or a joystick type input and the like.

Referring to FIG. 4, an example of using the steering input device 90for dictating a curvature 16 of a desired backing path of travel (POT)of the trailer 12 while backing up the trailer 12 with the vehicle 14 isshown. In preparation of backing the trailer 12, the driver of thevehicle 14 may drive the vehicle 14 forward along a pull-through path(PTP) to position the vehicle 14 and trailer 12 at a first backupposition B1. In the first backup position B1, the vehicle 14 and trailer12 are longitudinally aligned with each other such that a longitudinalcenterline axis L1 of the vehicle 14 is aligned with (e.g., parallelwith or coincidental with) a longitudinal centerline axis L2 of thetrailer 12. It is disclosed herein that such alignment of thelongitudinal axis L1, L2 at the onset of an instance of trailer backupfunctionality is not a requirement for operability of a trailer backupassist system 10, but may be done for calibration.

After activating the trailer backup assist system 10 (e.g., before,after, or during the pull-through sequence), the driver begins to backthe trailer 12 by reversing the vehicle 14 from the first backupposition B1. So long as the rotatable knob 92 of the trailer backupsteering input device 90 remains in the at-rest position P(AR) and noother steering input devices 70 are activated, the trailer backup assistsystem 10 will steer the vehicle 14 as necessary for causing the trailer12 to be backed along a substantially straight path of travel, asdefined by the longitudinal direction 22 of the trailer 12, specificallythe centerline axis L2 of the trailer 12, at the time when backing ofthe trailer 12 began. When the trailer 12 reaches the second backupposition B2, the driver rotates the rotatable knob 92 to command thetrailer 12 to be steered to the right (i.e., a knob position R(R)clockwise rotation). Accordingly, the trailer backup assist system 10will steer the vehicle 14 causing the trailer 12 to be steered to theright as a function of an amount of rotation of the rotatable knob 92with respect to the at-rest position P(AR), a rate movement of the knob92, and/or a direction of movement of the knob 92 with respect to theat-rest position P(AR). Similarly, the trailer 12 can be commanded tosteer to the left by rotating the rotatable knob 92 to the left. Whenthe trailer 12 reaches backup position B3, the driver allows therotatable knob 92 to return to the at-rest position P(AR) therebycausing the trailer backup assist system 10 to steer the vehicle 14 asnecessary for causing the trailer 12 to be backed along a substantiallystraight path of travel as defined by the longitudinal centerline axisL2 of the trailer 12 at the time when the rotatable knob 92 was returnedto the at-rest position P(AR). Thereafter, the trailer backup assistsystem 10 steers the vehicle 14 as necessary for causing the trailer 12to be backed along this substantially straight path to the fourth backupposition B4. In this regard, arcuate portions of a path of travel POT ofthe trailer 12 are dictated by rotation of the rotatable knob 92 andstraight portions of the path of travel POT are dictated by anorientation of the centerline longitudinal axis L2 of the trailer 12when the knob 92 is in/returned to the at-rest position P(AR).

Referring to FIG. 5, a camera 22 based sensor system 18 is shown,according to one embodiment, and is intended for use within the trailerbackup assist system 10. The camera 22 includes an image sensor 116 thatcaptures light and converts it into image data that is outputted to thevehicle display 26 and/or the trailer monitoring system 140, as will bedescribed in greater detail below. In order to accurately image thetarget 50 while the vehicle 14 and trailer 12 are in motion, one or moreimage capture settings of the camera 22 may need to be adjusted tocompensate for changing light conditions.

The target 50 may be configured in a rectangular configuration having achecker pattern that is recognizable by the camera 22. In oneembodiment, the checker pattern alternates between a first color and asecond color that is different than the first color. In one arrangement,the first color is green and the second color is red. In anotherarrangement, the first color is white and the second color is green.However, it should be appreciated that other target shapes, sizes,patterns, and color schemes may be employed.

A controller 118 that may be integrated with the camera 22 or locatedexternal thereto. The controller 118 can include circuitry such as aprocessor 120 and memory 122. A routine 124 for adjusting an imagecapture setting such as the white balance and the exposure of the camera22 can be stored in the memory 122 and is executed by the processor 120.In one embodiment, the controller 118 is configured to set a referencepoint corresponding to an area of the target 50 or trailer 12 that has aknown color. By knowing how the reference point should appear in acaptured image, the controller 118 can analyze image data received fromthe camera 22 and adjust the white balance and exposure of the camera 22to compensate for changing light conditions such as when the vehicle 14and trailer 12 move from a sunny area to a shaded area.

With respect to the illustrated embodiment, the controller 118 can alsocommunicate with a positioning device 54, shown as a GPS enabled device142 to receive input related to the geographical location of the vehicle14 and trailer 12. The GPS enabled device 142 can be any suitable devicecapable of communicating with the controller 118. In one embodiment, theGPS enabled device 142 is an onboard device such as, but not limited to,the HMI 88. In another embodiment, the GPS enabled device 142 is aportable electronic device such as, but not limited to, a portable GPSdevice or a GPS enabled smart device, both capable of wirelesslycommunicating with the controller 118 via Bluetooth®, WIFI, the like, ora combination thereof. Since light conditions may vary depending onone's geographical location, the controller 118 can give considerationto the locational input supplied by the GPS enabled device 142 indeciding whether an adjustment to the white balance and/or exposure ofthe camera 22 is needed.

Since light conditions may also vary depending on the current time,date, and weather conditions, the controller 118 can additionallyreceive time and date information via input 126 and weather informationvia input 128, which may either or both be considered by the controller118 in deciding whether an adjustment to the white balance and/orexposure of the camera 22 is needed. For example, the light intensity inFlorida during a clear summer afternoon will generally be higher thanthe light intensity in Michigan during an overcast summer morning. Thus,by making this type of information known to the controller 118, thecontroller 118 can predict certain characteristics related to the lightcaptured by the image sensor 116 of the camera 22 and adjust the imagecapture settings of the camera 22 accordingly. Per the previously givenexample, if a vehicle 14 and trailer 12 are located in Florida, thecontroller 118 may choose to decrease the exposure of the camera 22 andselect a white balance setting suited for higher color temperatureswhereas the controller 118 may choose to increase the exposure of thecamera 22 and select a white balance setting suited for lower colortemperatures if the vehicle 14 and trailer 12 are located in Michigan.It is contemplated that the controller 118 can receive the time and dateinformation via the GPS enabled device 142, a portable electronicdevice, the electronic control module (ECM) of the vehicle 14, or anyother suitable means. The weather information may be supplied to thecontroller 118 via an application running on a portable electronicdevice or an onboard device (e.g., HMI 88), or any other suitable means.

In addition to the above mentioned inputs, the controller 118 mayreceive input from one or more equipment 130 located on the vehicle 14and/or the trailer 12, which includes, but is not limited to, lightsensors, speed sensors, inertia sensors, directional compasses, and/orother cameras, which can be provided in front, rear, and side facingconfigurations. By leveraging some or all of the equipment 130 withother devices and inputs described previously, the controller 118 candetermine the orientation of the vehicle 14 and the trailer 12 relativeto a light source, such as the sun. In one embodiment, the controller118 can monitor the sun's location using input received from a suntracking application 132, which may be stored on an onboard device(e.g., HMI 88) or stored on an external device such as a portableelectrical device (e.g., smartphone). This information may be combinedwith date, time, and weather information received from inputs 126 and128, respectively, to enable the controller 118 to make adjustments tothe white balance and/or exposure of the camera 22 based on the sun'srelative position and expected light intensity.

Additionally, the controller 118 can monitor the orientation and headingof the vehicle 14 and trailer 12 relative to the sun via input receivedfrom directional compasses, speed sensors, inertia sensors, the GPSenabled device 142, and/or a GPS receiver 134 mounted to the trailer 12.Since the vehicle 14 and trailer 12 dimensions are typically known, thecontroller 118 can compare the orientation and heading information withthe sun's location to predict potential changes in light conditionsresulting from the vehicle 14 and/or trailer 12 blocking directsunlight, which can potentially impact the amount of light captured bythe image sensor 116 of the camera 22. For example, in some instances,the vehicle 14 and trailer 12 may be oriented relative to the sun suchthat the camera 22 and/or imaged area is flooded by sunlight, resultingin a relatively large amount of light being captured by the image sensor116 of the camera 22. In other instances, the vehicle 14 and trailer 12may be oriented relative to the sun such that the vehicle 14 and/ortrailer 12 are blocking the direct sunlight, which may result inrelatively less light being captured by the image sensor 116 of thecamera 22. In each of those cases, the controller 118 can use the abovementioned inputs and devices in considering whether an adjustment to thewhite balance and/or exposure of the camera 22 is needed. Furthermore,the controller 118 can also leverage image data received from othercameras provided on the vehicle 14 and/or trailer 12. Additionally oralternatively, the controller 118 can use light information received viaone or more light sensors on board the vehicle 14 and/or trailer 12. Thecontroller 118 can compare the image data and/or the light informationagainst the image data received from the camera 22. Any differencesbetween them can be considered when determining if an adjustment to thewhite balance and/or exposure of the camera 22 is needed.

According to one embodiment, the trailer backup assist system 10 isconfigured to compensate for changing light conditions caused from thevehicle lighting system 136 when the rear vehicle lights 138 of thevehicle 14 are activated. The rear lights may include taillights, brakelights 82, supplemental lights, and other forms of rear lighting. Whenactivated, the rear lights may project light upon the imaged scene,thereby causing a sudden change in lighting conditions. If unaccountedfor, the trailer backup assist system 10 may experience difficultytracking the target 50.

The controller 118 can receive status information from the vehiclelighting system 136 indicating whether any of the rear vehicle lights138 have been activated. Since the light characteristics (e.g., colortemperature and intensity) for any given rear vehicle light 138, such asthe brake light 82, is known, the controller 118 can subtract the colorcast projected by an activated rear vehicle light 138, such as the brakelight 82, from a captured image generated by the camera 22. In addition,the light intensity associated with the activated rear vehicle light138, such as the brake light 82, can be compensated for by eithermodifying the exposure of each pixel of the image sensor 116 or bycompensating the image after it has been captured. In this manner, theimage sensor 116 can respond with the appropriate adjustments to thewhite balance and/or exposure of the camera 22 when one or more rearvehicle lights 138 are activated.

Referring to FIG. 6, the routine 124 for adjusting the white balance andthe exposure of the camera 22 is illustrated, according to oneembodiment. The routine 124 begins at step 144 and proceeds to step 146to check if any rear vehicle lights 138 have been activated. Asdescribed previously, this can be accomplished by providing thecontroller 118 with status information related to the activation stateof each rear vehicle light 138, such as the brake light 82. If one ormore rear vehicle lights 138 have been activated, the routine 124proceeds to step 148 and the controller 118 makes a first adjustment tothe image capture settings of the camera 22. In one embodiment, thecontroller 118 subtracts the color cast projected from the activatedrear vehicle lights 138 from the captured image. Additionally oralternatively, the controller 118 compensates for the intensityassociated with the activated rear vehicle lights 138 by eithermodifying the exposure of each pixel or by compensating a capturedimage.

Once step 148 is satisfied, or if no rear vehicle lights 138 have beenactivated (step 146), the routine 124 proceeds to step 150 and thecontroller 118 receives one or more types of input. As describedpreviously herein, the input can include image data provided from thecamera 22, locational input provided from the GPS enabled device 142 andGPS receiver 134, time and date information provided from the time anddate input 126, weather information provided from the weather input 128,various inputs provided from one or more vehicle equipment 130, and suntracking information provided by the sun tracking application 132. Theroutine 124 then proceeds to step 152 and the controller 118 determineswhether or not to make a second adjustment to the image capture settingsof the camera 22. In making such a determination, the controller 118 mayuse some or all of the above mentioned inputs. If the controller 118decides that no adjustment is needed, the routine 124 outputs an imageat step 156. Alternatively, if the controller 118 decides an adjustmentis needed, the routine 124 proceeds to step 154 and the controller 118makes the second adjustment, which can include adjusting the whitebalance and/or exposure of the camera 22. Following the secondadjustment, the routine 124 outputs the adjusted image at step 156.

Referring to FIG. 7, the trailer backup assist system 10 for a vehicle14 is shown, according to one embodiment. The controller is configuredto separate sequential images captured by the camera 22. A first portionof images 28 may then be supplied to the display 26 and a second portionof images 30 is supplied to a vehicle system independently, such as thetrailer monitoring system 140. According to one embodiment, the firstportion of images 28 includes the first captured image and every otherimage thereafter. The first portion of images 28 may be displayed on thedisplay 26. The second portion of images 30 includes the second capturedimage and every other image thereafter. The second portion of images 30may be stored and/or further analyzed by the trailer monitoring system140. It will be appreciated, however, that any vehicle system mayprocess any of the image data. Further, it will also be appreciated thatthe vehicle 14 may separate the images in any pattern to any number ofportions and may supply that separated data to any number of systemswithin the vehicle 14.

The trailer monitoring system 140 may be a part of or otherwise utilizedin conjunction with a trailer backup assist system 10. For purposes ofillustration, the trailer monitoring system 140 is described herein asbeing adapted for use in the vehicle 14 shown in FIG. 1 and implementedusing certain features of the trailer backup assist system 10 shown inFIGS. 1 and 2. However, it should be appreciated that the trailermonitoring system 140 may be implemented with only features that areexclusive thereto in other embodiments. It should also be appreciatedthat some features of the trailer backup assist system 10 have beenomitted for clarity and the trailer monitoring system 140 is notnecessarily reliant on any particular embodiment of the trailer backupassist system 10.

As shown in FIG. 8, the trailer monitoring system 140 is communicativelycoupled to the camera 22 and/or a separate controller. Accordingly, thetrailer monitoring system 140 may include a controller 162 that maycorrespond to controller 74 described previously herein or a separatestandalone controller communicatively coupled to controller 74 and/orother control functions of the trailer backup assist system 10.Controller 162 may include memory 164 for storing one or more routinesincluding the image processing routine 166, a trailer tracking routine168, and a hitch angle calculation routine 170. The controller 162 mayalso include a microprocessor 172 and/or other analog and/or digitalcircuitry for processing the routines 166, 168, 170.

In operation, camera 22 is configured to image a scene rearward of thevehicle 14 and containing target 50, which is disposed on a trailer 12attached to the vehicle 14. The target 50 is typically an identifiablevisual target 50 that can be captured in an image by the camera 22 anddetected and processed via image processing. As described previouslyherein, camera 22 may be embodied as a video imaging camera thatrepeatedly captures successive images (i.e., frames) of the scene. Thefirst portion of images 28 may be displayed. The second portion ofimages 30 is supplied to the controller 162 to be processed with theimage processing routine 166 to identify the target 50 and its locationon the trailer 12. Once the target 50 has been identified, the hitchangle γ can be determined with the hitch angle calculation routine 170.For example, the hitch angle calculation routine 170 may determine thehitch angle γ by assessing characteristics of the target 50 such as, butnot limited to, the location and/or orientation of the target 50 withinthe image. Additionally, the location and/or orientation of the target50 may be tracked in successive images with the trailer tracking routine168 to determine additional trailer related information such as, but notlimited to, the rate of change of the hitch angle γ.

Each image from an image sensor 116 is received within the controller ofthe camera 22. Then, depending on the settings, user preference, and/orimage pattern, the image is sent either to the display 26 or to thetrailer monitoring system 140. In one embodiment, the camera processorsends every other image to display 26 and every other image to imageprocessing routine 166. In a system using an image sensor 116 thatoperates at sixty images per second, this means that the display 26 canstill receive images at 30 images per second. The vehicle camera 22 canprovide various image rates. Some applications use video streaming at orabove thirty fps, however, the technique herein can also be applied forlower image rates. The second portion of images 30 that are sent to thetrailer monitoring system 140 may be used to analyze the movement of thetarget 50 and may be concealed from an occupant of the vehicle 14 andmay be done every third image, fourth image, or even less. For example,a camera 22 running at 30 images per second may use 6 images per secondto process the direction and movement of the trailer target 50 therebyleaving 24 images per second for the display 26.

The ratio of images sent to the display 26 and the trailer monitoringsystem 140 can be adjusted to optimize each process for performanceand/or user experience. According to one embodiment, the ratio of imagessent to the display 26 versus the trailer monitoring system 140 maydiffer for the initial adjustment (e.g., every other image isprocessed), as compared to subsequent adjustments.

The second portion of images 30 that may be sent to the trailermonitoring system 140 are measured and quantified according to variousmetrics, as previously described herein. As described above, the imageprocessing routine may also conduct color processing and compression. Inother embodiments, other analysis may be added to the image processingroutine and the routines shown in FIG. 7 may be omitted or the order inwhich the routines are executed may be rearranged. According to oneembodiment, the second portion of images 30 that are sent to imageprocessing can be analyzed by color processing. Based on the results ofcolor processing, signals are sent to the camera 22 to set chip levelchannel biases, gain voltages and other chip level settings to correctfor image quality of subsequent images. Color processing may also updatethe image on the display 26 based on the results thereof

An example of an image 160 captured by camera 22 and disposed in thesecond portion of images 30 for analyzation by a vehicle system, such asthe trailer monitoring system 140, is shown in FIG. 9. The image 160contains the target 50, which is disposed on the tongue 40 of thetrailer 12. In other trailer 12 embodiments, the target 50 may belocated elsewhere. Given the numerous available vehicle 14 and trailer12 configurations, it is generally more practical for a user (e.g., thevehicle operator) to select a trailer location on which to place thetarget 50. Preferably, the target 50 is positioned on the trailer 12 ina designated target placement zone 174 that is optimized for imagecapture. The target placement zone 174 may be generated by thecontroller 162 and shown to a user on a display 26 of the vehicle 14.The controller 162 may determine the target placement zone 174 based oninformation related to the camera 22, the vehicle 14, and/or the trailer12. Additional information regarding target placement and targetmonitoring can be found in U.S. patent application Ser. No. 14/068,431,entitled “METHOD AND SYSTEM FOR MONITORING PLACEMENT OF A TARGET ON ATRAILER,” filed Oct. 31, 2014, the entire disclosure of which isincorporated herein by reference.

No matter where the target 50 is found on the trailer 12, the target 50will generally occupy a lesser portion of the image 160 when located atgreater distances from the camera 22. As a result, fewer pixels areavailable to represent the target 50, which may hinder the ability ofthe controller 162 to identify and track the target 50 so that anaccurate hitch angle γ can be determined. Recognizing this, thecontroller 162 may send the first portion of images 28 receivedtherefrom to the display 26 and the second portion of images 30 to thetrailer monitoring system 140, as described herein. The trailermonitoring system 140 may be configured to selectively modify imagescaptured by the camera 22 so that the target 50 occupies a largerportion of the total image within the trailer monitoring system 140. Atarget monitoring system method employing image modification mayfacilitate accurate target identification and tracking, thereby reducingerrors in hitch angle γ calculation.

In FIG. 10, a flow diagram of a target monitoring method 176 is shownand is exemplarily described herein as being implemented using thetrailer monitoring system 140 described above. At step 178, the camera22 images a scene rearward of the vehicle 14. The resulting image (e.g.,image 28) contains the environment rearwardly of the vehicle 14 and/orthe target 50 disposed on the trailer 12 that may be attached to avehicle 14. At step 190, the controller separates the images of thereceived image data based on a predefined sorting method. For example,every other image may be disposed in a first portion of images 28, or afirst bin, and a second portion of images 30, or a second bin. However,any other sorting method may also be used. At step 182, if the image isplaced in the first portion of images 28, the image is supplied to theHMI 88.

At step 210, if the image is separated into the second portion of images30, the image is supplied to the controller for image processing. Atstep 190, the image process routine analyzes the image to determine ifany adjustments need to be made to the image and/or the camera 22 basedon the plurality of inputs described herein. If a change is necessary,the change is administered to the image and each subsequent imagethereafter, at step 192. Simultaneously, if a change is necessary, thesame image corrections are administered to the first portion of images28 at step 186. The first portion of images 28 are then displayed on thedisplay 26 within the vehicle 14, with the corrections, if necessary, atstep 188.

Likewise, images in the second portion of images 30 are corrected atstep 192, if any correction is necessary. At step 194, the controller162 checks if the imaged target 50 meets a pixel size threshold. Thepixel size threshold may correspond to the minimum pixel size of theimaged target 50 that allows for accurate detection and tracking of thetarget 50 and may vary depending on the specifications of the camera 22and processing capabilities of the controller 162. In determining thepixel size threshold, various factors affecting target 50 detection maybe considered such as, but not limited to, environmental conditions,lighting conditions, the like, or a combination thereof. If the imagedtarget 50 meets the pixel size threshold, the method 176 continues tostep 198, which will be described further below. If the imaged target 50does not meet the pixel size threshold, the controller 162 modifies theimage to increase the image size of the target 50 relative to the totalsize of the captured image at step 196. In alternative embodiments, step194 may be omitted in favor of always modifying the image regardless ofthe image size of the target 50.

For purposes of illustration, image 172 is shown modified in FIG. 11.Specifically, the modification includes cropping the original image 160shown in FIG. 9 and centering the imaged target 50 therein. As a result,the imaged target 50 is substantially larger in the modified image 160than it was in the original image 182. At step 198, the modified imagemay be compressed and stored to memory 164 of the controller 162 orotherwise processed at step 200 with the trailer tracking routine 168and/or the hitch angle calculation routine 170. By compressing themodified image, more space is available in memory 164 for storingsubsequent modified images and the modified images may be processed athigher rates by the trailer tracking routine 168 and/or the hitch anglecalculation routine 170 at step 200. According to one embodiment, amodified image may be compressed from a 1 megapixel resolution to a 0.3megapixel resolution. Since the imaged target 50 has a greater pixelsize in the modified image, compression of the modified image does notgenerally degrade the image quality to an unacceptable level. At thecompletion of step 200 and/or 188, the method 176 may loop back to step178 to capture another image that undergoes processing according to thesteps outlined above. Accordingly, the display 26 within the vehicledisplays a first image of a first size and the trailer monitoring system140 monitors the processed image, which is not shown on the vehicledisplay 26, according to one embodiment.

Referring to FIGS. 12A-12B, the controller may be configured tointerlace consecutive images 202, 204 within the first portion of images28 that are sent to the display 26 within the vehicle 14. Since thesecond image 204 within the first portion of images 28 is displayedlater in time, the pixels hit in the second scan actually display animage that occurs slightly later in time than the image depicted by thefirst scan. In the case of a video sequence containing motion, such aswhen the vehicle 14 is in motion, the later of two images will displayobjects in different positions than in the previous field. Accordingly,interlaced images have the advantage of providing smoother motion sincethere are more incremental movements per second.

As illustrated in FIGS. 12A-12B, a process of interlacing consecutiveimages, or frames, is illustrated by determining a motion vector, orestimating motion, for a segment in a segmented image. It will beappreciated, however, that any form of video interlacing may be used bythe trailer backup assist system 10. As illustrated in FIG. 12A, image202 is segmented into a plurality of segments, of which segment 206 ishighlighted. As illustrated in FIG. 12B, image 204 occurs soon afterimage 202 in a video sequence, so it is likely to contain many of thesame objects as image 202. Some objects, however, may have moved ordeformed during the time elapsed between images 202 and 204. The pixelscomprising segment 206 are compared to the corresponding set of pixelsof same size and shape in a plurality of locations within image 204. Forinstance, typically a rectangular search area extending x pixelshorizontally and y pixels vertically, centered on the location ofsegment 206 in image 202, might be used. The location providing the bestmatch to the pixel data in segment 204 is located. Motion vector 208expresses the horizontal and vertical displacement between the originallocation of segment 206 in image 202 and the best matching new locationin image 204. This process may be repeated for each segment in image 202to determine a motion vector for each segment in image 204. A matchingthreshold may be used so that segments that fail to adequately match anylocation within image 202 are not assigned motion vectors at all. Anynumber of intermediate images may be interlaced between images from thecamera 22 to produce any desired refresh rate.

More advanced motion estimation techniques may also take into accountthe rotation, shear, contraction, expansion, or other deformation ofsegments between the two images. When these other parameters are allowedto vary in the search for a matching area in the later image, the motionvector expressing the best match for a segment will include not onlyhorizontal and vertical displacement, but also information regardingrotation, shear, contraction, expansion, and/or any other relevantdeformation data that may assist in providing clearer motion on thedisplay 26 of the first portion of images 28.

Accordingly, a trailer monitoring system and method have beenadvantageously provided herein for accurately detecting a target placedon a trailer. As a result, hitch angles and other trailer relatedinformation may be more accurately obtained. Such information may beused by a trailer backup assist system in aiding an operator of avehicle in performing a trailer backing maneuver.

According to various examples, a vehicle system is provided herein. Thevehicle system includes an imager generating images of a scene rearwardof a vehicle. The imager is configured to separate a plurality of theimages into a first portion or a second portion. A display disposedwithin the vehicle and configured to display the first portion ofimages. A controller is configured to analyze the second portion ofimages contemporaneously with the displaying of the first portion ofimages within the vehicle, adjust an image capture setting of the imagerbased on a status input, or modify each image in the second portion toincrease a size of an imaged target relative to a total size of thecaptured scene. Examples of the vehicle system can include any one or acombination of the following features:

-   -   the controller crops each image in the second portion about the        imaged target to create a modified image;    -   the imaged target is centered in the modified image;    -   the controller is further configured to compress each modified        image from a first resolution to a second resolution;    -   the image capture setting includes at least one of a white        balance and an exposure of the imager;    -   the controller analyzes the second portion of images at a        quicker speed than a refresh rate of display; and/or    -   the controller sets a reference point on the target and analyzes        image data with respect to the reference point to determine an        adjustment to the image capture setting.

Moreover, a vehicle assist method is provided herein. The methodincludes generating images of imaging a scene rearward of a vehicle. Themethod also includes separating the images into a first portion and asecond portion. The method further includes displaying the first portionof images on a display. The method includes using a controller to set areference point. Lastly, the method includes analyzing the secondportion of images with respect to the reference point to determine anadjustment to a camera image capture setting. Examples of the vehicleassist method can include any one or a combination of the followingfeatures:

-   -   modifying the second portion of images by cropping each image        about a target;    -   centering the imaged target within a modified image;    -   compressing each modified image from a first resolution to a        second resolution;    -   interlacing between successive images within the first portion        of images prior to placement on the display;    -   the interlacing between the successive images includes altering        a rotation, a shear, a contraction, an expansion, or a        deformation of various segments between the successive images;        and/or    -   applying the adjustment to the camera image capture setting to        the first portion of images prior to displaying the first        portion of images on the display.

According to some examples, a vehicle system is provided herein. Thevehicle system includes an imager configured to image a vehicle rearwardscene. The imager is configured to alternately distribute a plurality ofimages from the imager into independent first and second portions. Adisplay is configured to display the first portion of images. Acontroller is configured to receive the second portion of images andanalyze the second portion of images to determine at least onevehicle-related information. Examples of the vehicle system can includeany one or a combination of the following features:

-   -   the controller crops each image in the second portion about the        imaged target;    -   the controller is further configured to compress each image in        the second portion from a first resolution to a second        resolution;    -   the first portion of images includes a first image and a second        image and interlacing occurs between the first image and the        second image prior to presentation on the display;    -   a plurality of intermediate images are interlaced between the        first image and the second image to produce a desired refresh        rate; and/or    -   the controller is configured to adjust an image capture setting        of the imager based on a status input from a vehicle lighting        system, image data from the imager, or a locational input from a        positioning device.

It will be understood by one having ordinary skill in the art thatconstruction of the described invention and other components is notlimited to any specific material. Other exemplary embodiments of theinvention disclosed herein may be formed from a wide variety ofmaterials, unless described otherwise herein.

For purposes of this disclosure, the term “coupled” (in all of itsforms, couple, coupling, coupled, etc.) generally means the joining oftwo components (electrical or mechanical) directly or indirectly to oneanother. Such joining may be stationary in nature or movable in nature.Such joining may be achieved with the two components (electrical ormechanical) and any additional intermediate members being integrallyformed as a single unitary body with one another or with the twocomponents. Such joining may be permanent in nature or may be removableor releasable in nature unless otherwise stated.

It is also important to note that the construction and arrangement ofthe elements of the invention as shown in the exemplary embodiments isillustrative only. Although only a few embodiments of the presentinnovations have been described in detail in this disclosure, thoseskilled in the art who review this disclosure will readily appreciatethat many modifications are possible (e.g., variations in sizes,dimensions, structures, shapes and proportions of the various elements,values of parameters, mounting arrangements, use of materials, colors,orientations, etc.) without materially departing from the novelteachings and advantages of the subject matter recited. For example,elements shown as integrally formed may be constructed of multiple partsor elements shown as multiple parts may be integrally formed, theoperation of the interfaces may be reversed or otherwise varied, thelength or width of the structures and/or members or connector or otherelements of the system may be varied, and the nature or number ofadjustment positions provided between the elements may be varied. Itshould be noted that the elements and/or assemblies of the system may beconstructed from any of a wide variety of materials that providesufficient strength or durability, in any of a wide variety of colors,textures, and combinations. Accordingly, all such modifications areintended to be included within the scope of the present innovations.Other substitutions, modifications, changes, and omissions may be madein the design, operating conditions, and arrangement of the desired andother exemplary embodiments without departing from the spirit of thepresent innovations.

It will be understood that any described processes or steps withindescribed processes may be combined with other disclosed processes orsteps to form structures within the scope of the present invention. Theexemplary structures and processes disclosed herein are for illustrativepurposes and are not to be construed as limiting.

It is also to be understood that variations and modifications can bemade on the aforementioned structures and methods without departing fromthe concepts of the present invention, and further it is to beunderstood that such concepts are intended to be covered by thefollowing claims unless these claims by their language expressly stateotherwise.

What is claimed is:
 1. A vehicle system, comprising: an imagergenerating images of a scene rearward of a vehicle, wherein the imageris configured to separate a plurality of the images into a first portionor a second portion; a display disposed within the vehicle andconfigured to display the first portion of images; and a controllerconfigured to analyze the second portion of images contemporaneouslywith the displaying of the first portion of images within the vehicle,adjust an image capture setting of the imager based on a status input,or modify each image in the second portion to increase a size of animaged target relative to a total size of the captured scene.
 2. Thevehicle system of claim 1, wherein the controller crops each image inthe second portion about the imaged target to create a modified image.3. The vehicle system of claim 2, wherein the imaged target is centeredin the modified image.
 4. The vehicle system of claim 1, wherein thecontroller is further configured to compress each modified image from afirst resolution to a second resolution.
 5. The vehicle system of claim1, wherein the image capture setting includes at least one of a whitebalance and an exposure of the imager.
 6. The vehicle system of claim 1,wherein the controller analyzes the second portion of images at aquicker speed than a refresh rate of display.
 7. The vehicle system ofclaim 1, wherein the controller sets a reference point on the target andanalyzes image data with respect to the reference point to determine anadjustment to the image capture setting.
 8. A vehicle system,comprising: an imager configured to image a vehicle rearward scene,wherein the imager is configured to alternately distribute a pluralityof images from the imager into independent first and second portions; adisplay configured to display the first portion of images; and acontroller configured to receive the second portion of images andanalyze the second portion of images to determine at least onevehicle-related information.
 9. The vehicle system of claim 8, whereinthe controller crops each image in the second portion about the imagedtarget.
 10. The vehicle system of claim 8, wherein the controller isfurther configured to compress each image in the second portion from afirst resolution to a second resolution.
 11. The vehicle system of claim10, wherein the first portion of images includes a first image and asecond image and interlacing occurs between the first image and thesecond image prior to presentation on the display.
 12. The vehiclesystem of claim 11, wherein a plurality of intermediate images areinterlaced between the first image and the second image to produce adesired refresh rate.
 13. The vehicle system of claim 8, wherein thecontroller is configured to adjust an image capture setting of theimager based on a status input from a vehicle lighting system, imagedata from the imager, or a locational input from a positioning device.14. A vehicle assist method comprising the steps of: generating imagesof imaging a scene rearward of a vehicle; separating the images into afirst portion and a second portion; displaying the first portion ofimages on a display; using a controller to set a reference point; andanalyzing the second portion of images with respect to the referencepoint to determine an adjustment to a camera image capture setting. 15.The method of claim 14, further comprising the step of: modifying thesecond portion of images by cropping each image about a target.
 16. Themethod of claim 14, further comprising the step of: centering the imagedtarget within a modified image.
 17. The method of claim 14, furthercomprising the step of: compressing each modified image from a firstresolution to a second resolution.
 18. The method of claim 14, furthercomprising the step of: interlacing between successive images within thefirst portion of images prior to placement on the display.
 19. Themethod of claim 18, wherein the interlacing between the successiveimages includes altering a rotation, a shear, a contraction, anexpansion, or a deformation of various segments between the successiveimages.
 20. The method of claim 14, further comprising the step of:applying the adjustment to the camera image capture setting to the firstportion of images prior to displaying the first portion of images on thedisplay.